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Section I: 



AMENDMENT UNDER 37 CFR §1.121 to the CLAIMS 



1 . (currently amended) A computer-implemented method of communicating emotional 
aspects associated with a communication session from a first person to a second 
person, said method comprising the steps of: 

receiving an emotional state indicator output from automatic one or more 
emotional characteris t ic indica t ors from at least one emotional content analyzer system as 
the result of at leas t one emotional content analysis performed on said of a 
communication session from [[said]] a first person to a plurality of recipients, wherein 
each recipient is to receive a copy of said communication session ; 



retrieving a plurality of profiles corresponding to each of said recipients; 

determining an overall emotional state for said first person relative to 
said first p e rson's id e nti t y and said rec e iv e d e motional cont e nt analysis r e sults; 

for each recipient, determining an appropriate cmoticon or other symbol to reflect 
said emotional state in a manner consistent with each recipient profile; 

for each copy to each recipient, merging said emoticon or symbol into said 
communication session copy; and 

presenting said communication session, emoticons. and symbols to each of said 
plurality of recipients wherein each recipient receives symbols consistent with their own 
profile. 

genera t ing one or more electronic symbols represen t ing said overall emotion, said 
electronic symbols being interpretable by said second person; and 

presenting said electronic symbols t o said second person in association with said 
communication session . 



identifying k 



retrieving a profile for said first person 
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2. (currently amended) The computer-implemented method as set forth in Claim 1 wherein 
said step of receiving results output of a t leas t one emotional content analysis comprises 
receiving the results of a process selected from the group of a hand gesture 
recognizer, a body movement recognizer, a voice pitch analyzer, and a facial 
expression recognizer. 

3. (cancelled). 

4. (cancelled). 

5. (original) The computer-implemented method as set forth in Claim 1 wherein said step 
of generating one or more electronic symbols corresponding to said overall emotional 
state comprises generating an electronic symbol selected from the list of a text-based 
emoticon, a graphical emoticon, a text highlight method, a text size change, a text 
underlining method, a text holding method, one or more signals for a Telephone Terminal 
for the Deaf system, and a Braille code. 
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6. (currently amended) An article of manufacture for communicating emotional aspects 
associated with a communica t ion session from a firs t person to a second person, 
comprising: 

a computer readable medium suitable for storing computer programs; and 
one or more computer programs stored by said computer readable media, 
configured to cause a computer to perform the steps of: 

(a) receiving an emotional state indicator output from automatic one or more 
emotional charac t eris t ic indica t ors from at least one emotional content analyzer 
system as the resul t of a t least one emotional content analysis performed on said 
of a communication session from [[said]] a first person to a plurality of recipients, 
wherein each recipient is to receive a copy of said communication session ; 

(b) identifying retrieving a profile for said first person and said second person ; 

(c) retrieving a plurality of profiles corresponding to each of said recipients 
de t ermining an overall emo t ional s t a t e for said firs t person relative to 

said first person's identity and said received emotional cont e nt analysis r e sults ; 

(d) for each recipient, determining an appropriate emoticon or other symbol 

to reflect said emotional state in a manner consistent with each recipient profile; 

generating one or more electronic symbols represen t ing said overall 

emotion, said electronic symbols being interpretable by said second person; and 

(e) for each copy to each recipient, merging said emoticon or symbol into said 
communication session copy; and presen t ing on a user in t erface device said 
electronic symbols to said second person in associa t ion wi t h said communication 
session. 

(f) presenting said communication session, emoticons. and symbols to each of said 
plurality of recipients wherein each recipient receives symbols consistent with 
their own profile. 
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7. (currently amended) The article of manufacture as set forth in Claim 6 wherein said 
computer program for receiving resul t s output of at least one emotional content analysis 
comprises software for receiving the results of a process selected from the group of a 
hand gesture recognizer, a body movement recognizer, a voice pitch analyzer, and a 
facial expression recognizer. 

8. (cancelled). 

9. (cancelled). 

10. (previously presented) The article of manufacture as set forth in Claim 6 wherein said 
computer program for generating one or more electronic symbols corresponding to said 
overall emotional state comprises software for generating an electronic symbol selected 
from the list of a text-based emoticon, a graphical emoticon, a text highlight method, a 
text size change, a text underlining method, a text bolding method, one or more signals 
for a Telephone Terminal for the Deaf system, and a Braille code. 
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1 1 . (original) A system for communica t ing emo t ional aspec t s of a communication session 
from a first person to a second person, said system comprising: 

a recognizer input configured to receive an emotional state indicator output 
from automatic emotional content analysis of a communication session from a first 
person to a plurality of recipients, wherein each recipient is to receive a copy of said 
communication session resul t s of a t leas t one emotional content analyzer performed on 
said first person ; 

a set of user ID's configured to identify said first person and said second person; 

a retriever configured to retrieve a profile for said first person, and to 
retrieve a plurality of profiles corresponding to each of said recipients; 

an emotional state analyzer adapted to determine an overall emotional state for 
said first person rela t ive t o said firs t person's identity and said received emotional content 
analyzer results; 

a symbol generator adap t ed configured to determine for each recipient an 
appropriate cmoticon or other symbol to reflect said emotional state in a manner 
consistent with each recipient profile; generate one or mor e symbols r e pr e s e nting said 
ov e rall e motion, said symbols being suitable for interpretation by said s e cond p e rson; and 

a symbol merger configured to. for each copy to each recipient, merge said 
emoticon or symbol into said communication session copy; and for merging said 
generated symbols with said communication session for presen t a t ion t o said second 
person. 

a user interface configured to present said communication session, emoticons. and 
symbols to each of said plurality of recipients wherein each recipient receives symbols 
consistent with their own profile. 

12. (currently amended) The system as set forth in Claim 1 1 wherein said recognizer input is 
further adapted to receive the results of output from a recognizer selected from the group 
of a hand gesture recognizer, a body movement recognizer, a voice pitch analyzer, and a 
facial expression recognizer. 
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13. (cancelled) 



Janani Janakiraman 



Page 7 of 22 



14. (cancelled) 

15. (currently amended) The system as set forth in Claim 1 1 wherein said system generator 
is further adapted configured to generate a symbol selected from the list of a text-based 
emoticon, a graphical emoticon, a text highlight method, a text size change, a text 
underlining method, a text holding method, one or more signals for a Telephone Terminal 
for the Deaf system, and a Braille code. 

16. (currently amended) The system as set forth in Claim 1 1 wherein said symbol merger is 
adapted configured to merge a communication session selected from the group of an 
electronic mail message, an online text chat, a video conference, a online classroom, a 
captioned television broadcast, a multimedia presentation, and an open captioned 
meeting. 



